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Introduction 


Educational interventions, programs, or curricula are often put 
into place without attending to (a) what is needed to implement 
them well and support practitioners and (b) intentional 
processes to optimize the environment in which they are 
implemented (Fixsen et al., 2005; Lyon & Bruns, 2019). Whether 
coming from a state legislature, state or local education 

agency, board of education, school leadership, or even driven 
by practitioners, the pressure to adopt and implement an 
evidence-based practice or program to improve school and 
student outcomes can jeopardize an initiative’s ability to achieve 
its intended outcomes. School leaders and practitioners can 
harness two fields of inquiry—implementation science and 
improvement science —to increase the likelihood of success 
when moving a new evidence-based intervention, program, or 
curriculum into practice. Implementation science is the scientific 
study of methods and strategies that support the uptake of 
evidence-based practices into regular use (Eccles and Mittman, 
2006). This field of inquiry can help explain why only some 
education improvement efforts succeed and why only some 
improvements are sustained over time (Fixsen et al., 2013). 
Thus, leveraging core tenets of both improvement science 

and implementation science can set state and local education 
agencies up for success when rolling out new initiatives to 
improve student outcomes. 


The purpose of this Brief is to: 


a. compare implementation 
science and improvement 
science, 

b. illustrate how the core tenets 
of improvement science and 
implementation science can 
be utilized together to improve 
student outcomes and school 
efficiency, 

c. provide an example of 
how the synergy between 
implementation science and 
improvement science has been 
done effectively within a State 
Education Agency (SEA), and 

d. explain how implementation 
and improvement science 
can be utilized together in 
a school setting to improve 
implementation capacity and 
conditions. 


“Focus on quality is not only about reducing poor 
quality but also about implementing evidence to 
improve quality.” (Koczwara et al., 2018) 


: ml im I FRANK PORTER GRAHAM 
www.sisep.fpg.unc.edu (ul C CHILD DEVELOPMENT INSTITUTE 


Tan) ey aenic-rant-yalmeyed(-laler-Me) mm (nn) elisvuit-vale-lice)a meted (-1alere ig 


Implementation science and improvement 
science have both been leveraged to increase 
students’ academic, behavioral, and social- 
emotional outcomes. Implementation science 
emphasizes integrating implementation supports 
(e.g., training, coaching, teams, leadership) to 
move evidence-based practices into routine use. 
Furthermore, implementation science often starts 
with exploration activities, including identifying the 
need for a new practice or structures to support 
existing programs and creating readiness and 
buy-in. On the other hand, improvement science 
typically begins with a specific problem of practice 
that requires addressing. Improvement science 

— amethodology that focuses on improving 
practice — efforts are undertaken by a data-driven 
approach that aims to improve general practice, 
using cycles of inquiry systematically (e.g., plan- 
do-study-act [PDSA] cycles). Commonalities and 
differences exist between implementation and 


improvement sciences. Both sciences (a) rely 
heavily on data to assess their respective 
outcomes of interest, (6) focus on improving 
systems, (c) simultaneously address policy 
and practice, (d) use improvement cycles, 
and (e) attend to practitioner-level needs. 
Differences between improvement science 
and implementation science, however, 

should be highlighted. Primarily, improvement 
science is problem-specific and user-focused, 
while implementation science is context and 
practice concentrated. Both sciences focus on 
enhancing the use (adoption, implementation, 
and sustainment) of effective practices or 
programs to improve outcomes for students 
(Proctor et al., 2011). Table 1 outlines the 
key differences between the two sciences 
regarding purpose, problem, approach, and 
outcomes assessed. 


Table 1. 
Descriptions of implementation science and improvement science (Proctor et al., 2011; Koczwara et al., 2018) 
Implementation Science Improvement Science 
Work to promote the systematic uptake of 
; , Safety, 
PURPOSE evidence-based interventions/practices/ a ve ately aUeIY Salety ane 
programs into practice and policy 
. . ooo ; ’ in th 
Research and practice-based evidence sioniivant Sistupton OL alltel Tae 
education system that adversely affects 
is slow to be adopted in educational 
PROBLEM ,; students, staff, or the system as a whole 
practice, and uptake may be uneven fete 
; and prevents it from realizing its full 
across local or state education agencies potential 
Implementation frameworks and ner 
: ; ay t tool 
APPROACH airalegies\cadaciy: building Interventions (activities or tools) 
Implementation Outcomes Service Outcomes 
Potential Acceptability Feasibility Client-centeredness 
Outcomes Adoption Fidelity Effectiveness 
Appropriateness Penetration Efficiency 
Assessed é 
Cost Sustainability Equity 
Safety 
Timeliness 
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Figure 1. 
Plan-Study-Do-Act Improvement Cycles 


Once a need for change or new practice has been identified, it is critical not to jump straight 
to implementation efforts. Proper planning and capacity-building upfront will not only save 
time but also increase the likelihood of the change or practice having a sustained impact 

on students, families, or the community. Figure 1 exhibits a process for integrating the best 
practices of implementation science and improvement science for a defined program or 
practice. The flowchart, Figure 2, starts at the ‘Study’ phase of the Plan-Do-Study-Act cycles, 
where data are collected to ensure any changes or new practices address the need. Then, a 
team ‘Acts’ by defining a change or new practice. In the ‘Planning’ phase, the team creates a 
plan to build a hospitable environment and the needed infrastructure to support and sustain 
the change or new practice in the school or classroom. Finally, the plan is put into action, and 
practitioners are provided support as they implement the new program or practice. 
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Figure 2. 


Process for integrating implementation science with improvement science for a program or practice. 


Does an Implementation Team exist or can an existing team be repurposed? 


: Yes. Ensure that the team is representative, including: :No. Create a representative implementation team 
: those affected by new practices or changes, andhas : : with a working agreement. 
: a working agreement. . 3 


: Yes. Great! You're ready to set a goal(s). : : No. Conduct a Root Cause Analysis to get to the 
: : bottom of what the issue is. 


Has the team developed SMARTE (SMART with an equity-focus) goals related to the area that needs to 
improve or change? How will you know that you are successful? 


: Yes. Focus on the equitable nature of the goal(s)- _:_ : No. Set goals paying particular attention to how each : 
: what gaps need to be reduced or eliminated? : goal addresses service gaps. 


: Yes. Ensure the selection process includes a review : : No. Utilize the Hexagon Tool to engage in dialogue 
: of how each practice/change addresses need, fit, : : related to each potential to 

: and capacity to implement, as well as its evidence, = : 

: usability, and available support. 


Is the practice usable (is there enough information to make it trainable-learnable-doable-assessable 
in practice)? 


: Yes. Excellent! Begin identifying what external : : No. Ensure the program has a clear description 
: support might be needed. : : and program components, as well as operational 


: definitions and_a practical fidelity assessment. 


: Yes. Excellent. Double check the right people are : No. Conduct an initiative inventory to: (1) identify 

: around the table to help remove some of these : : other initiatives/programs in place and (2) determine 
: barriers. : : whether other initiatives need to be aligned or 

: : deselected. 


Does a plan exist to address training; coaching; monitoring fidelity/integrity, processes, and outcomes; 
communication; and identifying potential barriers related to the implementation of the practice? 


Yes. Also consider whether it is worth starting : No. Work with the team to build a plan that 
: implementing with a smaller group to increase : : addresses infrastructure needed to support 


: learning. Smaller groups, but at a higher frequency ae implementation. 
: review yield better information. 


: Yes. Great, you are ready to begin implementing the : : No. Before implementing, establish a process to use : 
: plan. : : data for ongoing decision-making. : 
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Case Study IMPROVEMENT PROCESS 


In 2020, the Michigan Department of Education 


launched the Michigan Integrated Continuous 
Improvement Process (MICIP) to support districts’ 


continuous improvement efforts by integrating 
implementation best practices. Using an equity 
lens, MICIP centers a whole child approach in the 
context of continuous improvement and systems 
change. Implementation best practices are 
incorporated into the practice selection process; 
it attends to creating buy-in and readiness while 
also focusing on establishing systems and 
structures to support implementation (aligned 
selection-training-coaching-fidelity assessment 
processes), monitoring, and evaluation. 
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